Dependability Benchmarks for Operating Systems
نویسندگان
چکیده
Dependability evaluation is playing an increasing role in system and software engineering together with performance evaluation. Performance benchmarks are widely used to evaluate system performance while dependability benchmarks are hardly emerging. A dependability benchmark for operating systems is intended to objectively characterize the operating system's behavior in the presence of faults, through dependability and performance-related measures, obtained by means of controlled experiments. This paper presents a dependability benchmark for general-purpose operating systems and its application to three versions of Windows operating system and four versions of Linux operating system. The benchmark measures are: operating system robustness (as regards possible erroneous inputs provided by the application software to the operating system via the application programming interface), operating system reaction and restart times in the presence of faults. The workload is JVM (Java Virtual Machine), a software layer, on top of the operating system allowing applications in Java language to be platform independent.
منابع مشابه
Comparing Operating Systems Using Robustness Benchmarks
When creating mission-critical distributed systems using off-the-shelf components, it is important to assess the dependability of not only the hardware, but the software as well. This paper proposes a way to test operating system dependability. The concept of response regions is presented as a way to visualize erroneous system behavior and gain insight into failure mechanisms. A 5-point “CRASH”...
متن کاملDescription of the Selected Enabling Technologies
The goal of dependability benchmarking is to provide generic ways for characterizing the behavior of components and computer systems in the presence of faults, allowing for the quantification of dependability measures. Beyond existing evaluation techniques, dependability benchmarking must provide a reproducible and cost-effective way of performing such a characterization, especially for compara...
متن کاملWindows and Linux Robustness Benchmarks With Respect to Application Erroneous Behavior
This chapter presents the specification of dependability benchmarks for general-purpose operating systems with respect to application erroneous behavior, and shows examples of benchmark results obtained for various versions of Windows and Linux operating systems. The benchmark measures are: operating system robustness (as regards possible erroneous inputs provided by the application software to...
متن کاملDependability Benchmarking of Computing Systems
A Black-Box Approach to Dependability Benchmarking of Computer Hardware Examples of silent data corruption (SDC), induced by intermittent faults, are given. Two techniques, based on environmental tests, are used to detect SDC: an operating temperature and voltage test, and an electrostatic discharge test. Systems under evaluation execute a Linpack benchmark, which checks correctness of the calc...
متن کاملHenrique Madeira (University of Coimbra)
The goal of dependability benchmarking is to provide generic ways for characterizing the behaviour of components and computer systems in the presence of faults, allowing for the quantification of dependability measures. Beyond existing evaluation techniques, dependability benchmarking must provide a reproducible and cost-effective way of performing such a characterization, especially for compar...
متن کامل